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The identification of talent, and the unders t andir.a 
of its development and oriqins in terms of biographical data were 
investigated. The three central objectives were: to construct 
separate empirical procedures for Anglos and Slacks to predict 
certain academic performance criteria; to construct an empirical 
scorinq procedure that could predict estimated family income in order 
to provide information about the socio-economic and biographical 
correlates of such data: and finally, to conduct a separate analysis 
on the five most integrated schools in the sample to examine the 
interrelationships of the measures in this selected sample. The paper 
surveys the literature, discusses the procedure used to construct the 
Biographical Inventory (BI) , presents reliability and validity data 
on the instrument, analyzes various aspects of the sample, and 
discusses the differential measures of some bioaraphical corrlea^es 
of family income as indicated in the sample by th^ BT. The FI keys 
constructed were found to be substantially more valid in Dredictino 
academic performance and college attendance than IQ, college boards 
or other non-hiogra ph ica 1 predictors. Keys built on Blacks were as 
valid for Anglos as keys constructed on Anglos. Blacks were eoual or 
slightly superior to Anglos in academic performance and creativity 
when the family income variable was controlled; and Blacks scored 
q significantly lower on intellectual tests even when the effects of 
family income were controlled. Statistical data and a bibliography 
are included. ( AF) 
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INTRODUCTION 



The biographical correlates of talent and achievement, or what 
might be better termed non-intellectual measures of performance, cover 
an area of research that has been growing rapdily, with the avail- 
ability of high speed computers, especially during the past 10 years. 
The biographical approach has been used to identify a wide variety of 
different kinds of talents including successful performance among 
scientists, executives, nurses, graduate students, army officers, etc. 
This research approach has not been typical of the usual techniques 
for the identification of talent which has primarily been restricted 
to intellectual measures, including achievement, intelligence and 
academic aptitude tests. In order to consider the potential contri- 
bution of the biographical approach presented in this research, it 
will be helpful to digress and briefly review the context within which 
such procedures would be used. 

The growth and scope of testing programs in the U.S. has reached 
such a level that there can be no doubt about our national committment 
to testing. Goslin (1963) has estimated that there are more ability 
tests being given annually than there are people. In 1961, commercial 
test publishers so^ test booklets and answer sheets valued at over 
$11,000,000. This represented an increase of more than 100% over the 
sales 7 years previously (Goslin, 1963). Ostensibly, the majority of 
the tests in the intellectual sphere are concerned with the identi- 
fication of talent -- the selection of the gifted -- and the measure- 
ment of achievement. In a practical sense, the scores from these tests 
provide a basis for making rational decisions about the selection and 
placement of individuals in a wide variety of situations and organi- 
zations. 

In the case of college freshmen, who provide a substantial 
market for the testing industry, the tests are primarily used to 
designate the intellectual elite from those who are less academically 
qualified. If the effectiveness of these measures is gauged in terms 
of how well they predict college academic performance, the results vary 
depending on the selectivity of the institutions. Generally, however, 
the zero order correlations vary around .50 (Levin, 1965). Such 
relationships can be explained in a number of ways. For example, 
approximately 25% of the variation in college grades can be predicted 
or explained by college entrance scores; alternately, 75% must be 
attributed to other factors such as random variability in college 
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grades, motivation, study habits, etc. A more practical inter- 
pretation can be obtained through the use of some percentage of 
correct classification system such as the Taylor-Russell Tables 
(1939). To take an hypothetical example, with a correlation of 
.50, if one wanted to identify in advance those students who 
would be in the top 30% of the class and selected the top 30% on 
the entrance test scores, 52% out of those selected would be in 
the top 30% and would be correctly classified, while 48% of those 
selected on the basio of test scores would not be in the top 1/3 
of their class*. Also, 74% of those selected would be above average, 
i.e., in the top 50%. Carrying the example still further, approxi- 
mately 26% of those scoring in the top 30% of the test scores 
would be below average in college grades. 

The above illustrations indicate that intellectual tests do 
have some utility as selection devices for their best area of 
prediction, although there is room for improvement. Utility, in 
this case, is defined in terms of effectiveness in predicting 
college grades. Since college grades have shown at best only 
limited utility in predicting relevant measures of adult achieve- 
ment (Hoyt, 1966; Taylor and Ellison, 1967), the entire system of 
intellectual tests and our present education process can be 
questioned on empirical grounds as well as by student protestors 
who cry for greater relevance. 

Our current intellectual and achievement tests have other 
characteristics which have stimulated a great deal of controversy, 
namely the extent to which they discriminate or differentiate un- 
fairly between Anglos and Blacks^ and other culturally disadvantaged 
groups . 

Discussions of this issue have been reported widely in the popu- 
lar press - Life (June 12, 1970) - and in such prestigious scientific 
journals as Science and the Harvard Educational Review. Although a 
wide array of opinions have been presented, they essentially vary 



1 

These examples do not include high school grades, the quality 
of the high school or other factors which are often combined with 
entrance test scores in multiple regression equations to predict 
college success. The correlations of these combined variables with 
college grade point average may achieve a level of .55 to .65 or 
higher, depending upon the institution and the number of variables 
in question. 

2 

This style has been adopted in accordance with its increasing 
frequency of usage, e.g., Ruch (1970). 

- 2 - 
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around two contrasting positions: (1) that the differences between 
mean scores of Blacks and Anglos on standardized intelligence tests 
probably reflect genetic differences in certain aspects of intellec- 
tual functioning (Garrett; 1960, Shuey, 1966; Jensen, 1969), (2) that 
these test score differences merely reflect the lack of opportunity 
and the inadequate state of social development which characterize 
our culturally disadvantaged groups. 

These debatable characteristics of intellectual selection 
devices, particularly for college entrants, has brought forth a 
variety of views. In a recent editorial in Science, Wolfle (1970) 
posed two extreme points of view: "When the number of eligible people 
exceed the number who must bear a particular burden or who can re- 
ceive a particular benefit, the most democratic, equitable, and moral 
basis for allocation is by chance." This was contrasted with "To use 
a lottery to allocate risks or benefits is not only a denial of 
rationality, it is also a denial of man's humanity; each man is re- 
duced to a cipher, distinguished from other ciphers only by the unique- 
ness of the combination of digits that identify his records in a 
growing number of office files" (p. 1201). 

This polar statement of the issues brought forth a response by 
Ashby (1970) that decisions, to be rational and defensible, must be 
based on information and the more information available the more 
appropriate the decisions. 

Earlier, a similar discussion of these issues was also reported 
in Science. The initial articles were by Nelson (1969a, 1969b) who 
presented data which argued that Blacks were underrepresented in our 
college population and that an important part of such underrepresen- 
tation was due to screening by the college entrance exams. 

These articles brought forth responses from Stanley (1969) who 
argued that the predictiveness of the entrance tests apply at least 
as fully to the disadvantaged as to the advantaged. He suggested 
that changes in the curriculum be developed to prepare the dis- 
advantaged for adequate performance at the college level, although 
he knew of no evidence to support the proposition that students 
initially low in high school grades and academic aptitude scores 
catch up. Humphreys (1969) took a similar position, arguing that 
the colleges were damned if they did admit Blacks as their high fail- 
ure rate would lead to frustration and aggressive behavior, and damned 
if they didn't because of pressure^ for social advancement. 

To summarize briefly, the issues presented about the applica- 
tions of intellectual tests involve the following: 
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(1) Our society has broadly accepted and institutionalized 
testing practices which involve a large financial and social invest- 
ment - a committment which could be difficult to change. 

(2) The intellectual tests generally have a moderate level 
of validity in predicting academic criteria. 

(3) The criteria of academic performance which many of the 
tests were designed to predict have at best shown very limited 
relationships to measures of professional accomplishment. 

(4) The tests do distinguish, fairly or unfairly, between 
Anglos and blacks. 

This brief review of the characteristics of intellectual tests 
will provide an opportunity for compai ing and evaluating the results 
obtained from the present investigation which examined an alternate 
approach to the identification of talent - the use of non-intellectual 
or biographical data. 

Review of Biographical Studies 

The use of biographical information has a long and successful 
history as a selection procedure, but it has been only relatively 
recently that extensive systematic research has begun to acctimulate . 
The term biographical information refers to a collection of multiple 
choice questions in which an individual describes himself and his 
background, with many of the questions being similar to those found 
on an application blank. The rationale in using such an approach is 
very simple - that past behavior can be used as an indicator of future 
behavior and performance. 

One of the first known uses of scientifically scored biographi- 
cal data originated with Goldsmith ( 1922 ) when she wrote on "The Use 
of a Personal History Blank as a Salesmanship Test.” Another early 
example is a study by Bittner (1945), who utilized biographical in- 
formation to predict college attendance or non-attendance. On the 
basis of earlier experience with biographical data and the retention 
of U. S, Army Officers, Hansen, in 1950, demonstrated that biographi- 
cal data could be used to predict high school GPA and over and under 
achievement with cross validities as high as .60. 

An early program of research was reported by Parrish and Drucker 
(1957) covering a 16 year period by the AGO, USA, which indicated 
that biographical information was the most consistently successful 
device for predicting peer and tactical officer ratings of leader- 
ship in OCS (r=.45). A closely related study by Roy, Brueckel and 
Drucker (1954) found biographical information more valid than an)' 

-4- 
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combination of 10 tests of aptitude, attitude and physical proficiency 
in predicting ROIC leadership ratings of officers and cadet peers at 
six schools (n=2003). A more recent example is a study by Williams 
(1961), who utilized only 21 items and was able to predict volunteering 
vs. non-volunteering for an advance A.F.R.O.T.C. program to the extent 
of an r of 0.72 in an untouched prediction sub-sample of over 200 
cases . 

In the majority of biographical information studies, the criteria 
have involved world of work performances such as leadership, creativity, 
reenlistment, etc., which have been relatively impervious to prediction 
by more conventional procedures. It was in this context that the early 
developmental research originated which laid the foundation for the 
instrument used in the present study. 

In the late 1950's small studies by Taylor (1957) and Ellison 
(1959) indicated that biographical data had promise for making a 
significant contribution to the identification of scientific talent. 

On this basis, a four year study was initiated in 1959 (Taylor, Ellison 
and Tucker, 1964; Taylor and Ellison, 1967) to evaluate the effecti- 
veness of biographical data in predicting a variety of scientific 
performance criteria including supervisory ratings on creativity, 
quantity of work, quantity of publications and patents, etc. 

The studies involved over 2,000 scientists and engineers at several 
NASA research centers. The results showed that creativity and other 
scientific performance measures could be predicted by biographical 
data with cross validities ranging from .30 to .59. 

Later, three industrial studies or the biographical correlates 
of scientific and engineering talent on another 1,000 scientists and 
engineers 3 confirmed the general effectiveness of biographical data 
in predicting different criteria of scientific and engineering per- 
formance, including measures of creative performance (i.e., publi- 
cations, patents, supervisory ratings) and a number of job performance 
criteria other than creativity, such as salary (corrected for education 
and experience), communication skills, group leadership, breadth of 
knowledge, etc. 

In order to determine the validity of the biographical approach 
ip. predicting undergraduate academic performance, a new form of the 
Biographical Inventory (BI) , Form J, was developed. This form in- 
cluded the previously validated creativity items and a number of new 



3 

Ellison, R. L., James, L. R. , & Carron, T., 1968; Ellison, R. L., 
James, L. R. , McDonald, B. W. , 6 Taylor, C. W., 1968; Ellison, R. L., 
James, L. R. , Fox, D. G., 5 Taylor, C. W. , 1968. 
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items constructed specifically to predict academic performance at 
the college freshmen level (IBRIC, 1968). Form J of the BI was 
administered to the freshman class at Ohio University in November, 
1966, The grade point average for the first semester of the fresh- 
man year was also acquired later. The size of the sample on which 
complete data were finally received included 1,525 females and 
1,439 males. An item analysis of the BI against the first semester 
grade point average resulted in cross validities of .60 for females 
and . 58 for males . 

In view of the positive results obtained at the college level 
and because of the availability of a creativity score validated on 
adult scientists and engineers, interest was generated for t large 
study of North Carolina high sch • >1 students. In this study (IBRIC, 
1968), high school versions (grades 9 - 12) of the BI (Forms L and 
M, which were very similar to Form J and the Alpha form developed 
later, IBRIC, 1968) were constructed and administered to a sample 
of over 11,000 high school students in North Carolina. It was this 
large mass of data that provided the opportunity for the present 
study. 

The results from the initial processing of data (IBRIC, 1968) 
from the North Carolina study indicated that the BI Academic Perform- 
ance score was consistently more valid in predicting the academic 
performance criteria - grades and teacher evaluations - than any 
of ^he other 24 scores obtained from intelligence tests and achieve- 
ment measures. Cross validities for the Academic Performance score 
were .70 for Anglo males, .67 for Anglo females, .43 for Black males, 
and .43 for female Blacks in predicting rank in class. Equally 
important, the Academic Performance score aid not show the usual 
pattern of discrimination in terms of race (a correlation of .02 
w r s obtained between the BI Acadeuic Performance score and the 
binary variable of race, where Blacks were coded as 1 and Anglos 
as 2j t As stated previously, these results showing a lack of racial 
discrimination are in marked contrast to conventional approaches to 
the identification of talent. 

The Creativity score, basec on the responses of the NASA and 
industrial scientists and engineers, had a pattern of low to moderate 
relationships with conventional measures of talent and criteria of 
academic achievement (e.g., a correlation of .44 was obtained with 



4 

The coding of Blacks and Anglos was revised from the earlier 
study, reprinted in the Alpha Manual (IBRIC, 1968) in order to 
simplify the interpretation of some of the relationships in the 
present study. 
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the SAT total score). Since no relevant creativity criteria were 
included in the study, it was not possible to evaluate the actual 
validity of the Creativity score. The correlation of .44 with the 
SAT in conjunction with the correlation of .22 with high school 
GPA suggests that the Creativity score measures a component of 
intellectual effectiveness, which is not as strongly associated 
with the more conforming academic achievement measures of GPA. 

This is supported by studies by Taylor (1963, 1964a, 1964b), Hoyt 
(1966) and others which indicate that GPA measures typically have 
a low relationship to scientific creativity. The Creativity score 
was also independent of race, with no significant difference be- 
ween the scores for Black students and Anglo students. 

Results have recently been obtained in a number of institu- 
tions which support the potential contribution of biographical data 
in predicting college performance as distinct from high school per- 
formance where more validity evidence is available as described 
previously. 

In a study at Wake Forest University, Price (1969) reported 
that the Academic Performance score of the Alpha BI had a validity 
of .41 against GPA on a sample of 630 freshmen. The SAT Verbal and 
SAT Mathematical had validities of .36 and .31 on the same sample . 

A follow-up study of 835 students who completed an early 
version of the Alpha BI in the North Carolina study as high school 
seniors and then entered a variety of four year colleges rjvealed 
a somewhat similar pattern of results (Britt, 1970). The vali- 
dities of the Academic Performance score across the institutions 
studied were .47 for males and .43 for females. The validities 
for the SAT Verbal and SAT Mathematical were .31 and .25 for females 
and .33 and .25 for males. The validity of high school grades in 
predicting college grades for these students was .40. 

It is believed that these findings potentially represent an 
important contribution to our understanding of talent and how to 
identify it at an early age without discrimination in terms of race. 
These findings were obtained for a number of reasons: 



5 

Although the students were selected on the basis of their SAT score, 
the data indicated an equivalent amount of restriction of range for the 
Alpha Academic Performance score. It was also of interest to note that 
the Creativity score contributed to the prediction of GPA in a multiple 
regression equation as a suppressor variable, correlating significantly 
with SAT Verbal (.28) and the Alpha Academic Performance score (.42), 
but had an essentially zero relationship with the GPA criterion. 
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1. The Biographical Inventory is composed of a large 
collection of carefully screened, heterogeneous, 
multiple choice items that have been extensively 
validated to predict a variety of relevant per- 
formances. These items measure a variety of past 
behaviors and environmental pressures across situ- 
ations encountered in an individual^ background 
and thus the items can be scored to predict a 
number of performance criteria in different settings. 

2. All the empirically constructed keys from the 
Biographical Inventory which were essentially free 
of racial bias were constructed upon samples where 
the criterion measures themselves were not biased 

in terms of race. Hence, the keys generally paralleled 
the criteria and did not discriminate in terms of race. 

For example, the Creativity Key was constructed on 
many samples of Anglo scientists and engineers; there- 
fore the keys reflected performance yet did not discri- 
minate in terms of race. The same is true of the 
Academic Performance keys which were constructed at a 
large Midwestern university where Blacks comprised 
such a small part of the student population that there 
was essentially no racial bias in the Academic Perform- 
ance key constructed to predict first semester grades. 

3. The rank in class and grade point average criteria in 
the North Carolina study were not racially biased to 
any appreciable extent since the vast majority of 
schools studied were segregated according to race. 

This combination of events resulted in the Biographical keys 
being highly valid and at the same time not discriminating in terms 
of race. 

Because of the highly significant results that were obtained in 
the North Carolina study and because of the important implications 
for the identification of talent and understanding its social and 
cultural antecedents, it was believed that these data warranted 
further analysis. This evidence led to the present study. 

In the data analysis already completed, all available measures 
were intercorrelate 1 and empirical keys were constructed from the 
biographical data to predict selected measures. Separate empirical 
keys were constructed to predict rank ir» class, grade point average, 
and IQ on the total sample. However, the general level of prediction 
tended to be somewhat 3ower for Blacks than for Anglos. Therefore, 
there was a real need to build new empirical keys on Anglos only and 
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on Blacks only to predict rank in class and grade point average. 

For example, the key constructed to predict grade point average on 
the total sample cross validated on Anglos with a cross validity of 
.68, while on Blacks the cross validity was .57. For the key con- 
structed to predict rank in class on the total sample, the cross 
validity for Anglos was .71 and the cross validity for Blacks was 
.48. Both Biographical Inventory keys were consistently more valid 
for both Anglos and Blacks than any of the other non-biographical 
measures included in the analysis. This same pattern was apparent 
across all remaining variables, with Anglos being generally more 
predictable than Blacks. 

Another important step in utilizing the data fully concerned 
the construction of an empirical key to predict estimated family 
income. The income measure was provided by the schools and proved 
to be a very meaningful variable throughout the analysis, as it 
correlated .51 with race and had a number of other moderate relation- 
ships (correlations in the . 30's and . 40's and occasionally higher) 
with other variables included in the analysis. It was believed that 
an empirical key constructed to predict this measure from the bio- 
graphical data would yield valuable information about levels of 
achievement and the attitudes, self-descriptions, and enviornmental 
characteristics associated with family income. 

Finally, a further analysis of the North Carolina data was 
warranted in terms of a separate examination of the small number 
of schools which were partially integrated. For example, the students 
in the five most integrated schools could be combined to provide a 
sample of approximately 500 Black students and 1,000 Anglo students. 

It was anticipated that these schools would more adequately represent 
our present state of social development where Elacks and Anglos may 
have different levels of achievement in academic performance. Such 
a subsample would be valuable for a more thorough analysis of the 
relationships among all the measures, particularly the validities 
of the Biographical Inventory keys. 

To summarize, the specific objectives of this research were 
as follows: 

• To construct separate empirical keys on Anglos and 
Blacks for predicting rank in class and grade point 
average. 

• To construct an empricial key for predicting estimated 
family income and thereby provide information about 
the socio-economic and biographical correlates of 
such data. 
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• To conduct a separate analysis on the integrated schools 
to examine the interrelations among all measures used in 
this selected sample. 

The literature review so far presented has been primarily con- 
cerned with research findings dealing with biographical literature. 

Since other areas of research are also relevant to the above objectives, 
these wiK be briefly reviewed in the next section. 

Other Related Literature 



Levin (1965) in reviewing the professional literature on the 
prediction of academic performance reported that socio-economic level 
was directly related to academic performances in 13 studies. Of 
special interest were six studies whose findings contrasted with these 
results, i.e., socio-economic status (SES) was inversely related to 
performance. After reviewing all of the studies, Levin felt that the 
results varied with the kind of samples studied. Within upper classes 
the relationship was negative, while within middle classes it was 
positive. He went on to suggest that differential motivation may be 
a possible explanation (i.e., middle classes use school to increase 
status while upper classes use it to maintain their level) together 
with differences in attitudes (i.e., middle looks toward progress and 
achievement while upper looks toward tradition). He concluded that: 

SES is a significant variable in the study of performance. . 

. . .what is needed is a thorough review of the differences 
in personality, values-systems, and behavior that are 
related to SES. Such class-related variables can then be 
applied to the study of achievement in school (p. 127). 



The present study will provide additional information about the 
life history correlates of family income. 

Dreger and Miller (1968) state that matching of social groups by 
social class variables is not a solution to a true matching on environ- 
mental variables. 

Nevertheless, it is at this point probably the only way 
in which a measure of equating can be achieved experi- 
mentally in the United States. Therefore, attention 
should be paid to results obtained when such matching 
is attempted (p. 15) . 

Summarizing more than a dozen studies, Pasamanick and Knobloch 
(1958) concluded that both socio-economic facts and neurological 
factors are responsible for educational retardation. They assert 
that nutritional factors seem to be implicated in complications 
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surrounding pregnancy and in prematurity, factors which presumably 
are directly related to socio-economic status. 

In summarizing this literature, Dreger and Miller comment upon 
the psychological dynamics of lower income status as follows: 

Although the expressed vocational level of 
aspiration may be high, the functional levels of 
striving of the lower-class child are low, and 
failure leads to loss of academic interest and a 
perception that the child cannot achieve because 
of his status. It follows, thei, that failure 
comes in developing the "ego maturity rf that is 
necessary for success. In addition, the fact of 
caste membership for the Black child acts as an 
ultimate barrier, so that finally self-depreciation 
and primarily passive-aggressive retaliatory 
mechanisms develop (p. 28). 

This review has not confronted directly the complex issue of 
intelligence and other differences in Black and Anglos, first, because 
such a review is beyond the scope and focus of this study and secondly, 
the investigators believe that most conclusions are premature in view 
of the complexities involved. As illustrated by Dreger and Miller 



The situation has become clearer that psychological 
reactions of the sorts compared here are not the simple 
produce of "heredity" and "environment" grossly undefined, 
but of specific interactions of specific variables. Of 
these variables the following may be named as having been 
investigated in some combinations or others; societal and 
cultural goals, including ideologies; community structure 
and goals; geographical locale; socio-economic status; 
caste status; child-rearing attitudes and practices; 
family structure; positions, roles, and role expectancies; 
gene patterns, themselves a congeries of variables; 
neurological status; sex; biochemical functioning; 
prenatal experiences; perceptual development, including 
time and space perception; language development, including 
speech communication complexities and expectancy patterns; 
self-concepts and attitudes, particularly self-esteem; 
levels of aspiration, real and expressed; expressive 
opportunities, including vocational; peer relations; 
individual psychodynamics and group sociodynamics; 
cognitive expectancies relating to functions served 
by different types of cognition; cognitive styles, 
individual and social; measurement instrument variables; 
examiner variables; and immediate situational stimulation. 
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They close their review with an exquisite statement that 
would only take a staff of many Ph.D.’s many, many years of effort 
to achieve . . . 

Perhaps the ideal experimental design for analyzing 
the now more or less recognized complexities would 
be a multivariate analysis of variance with inter- 
actions reaching to the 25th order or a canonical 
correlation analysis with an expectancy of at least 
10 roots (p. 548). 
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PROCEDURE 



Data Collection and Description 

As previously discussed, two 300 item forms of the Biographical 
Inventory, Forms L and M, were administered to over 11,000 ninth and 
twelfth grade students in North Carolina during the last half of the 
1966-1967 school year. These forms were developed on the basis of 
previous research completed at several scientific research centers 
and at Ohio University. Valid items for predicting creativity and 
other job performance criteria from the scientific performance studies 
and valid items which correlated with academic performance in the Ohio 
study were included in the two forms. These items were carefully 
screened, reviewed by test construction experts, and revised where 
necessary to ensure that the items were appropriate in content and 
clarity for administration at the high school level. Forms L and M 
were given to the 9th and 12th grade students, respectively. These 
two forms were identical except for the last eight items which were 
aimed more directly at activities appropriate for each grade level. 

The BI’s were not adminsitered under stringent conditions. Some 
students completed the BI in the classroom in one session, others 
were given two such sessions, and a third group completed the BI at 
home. At present, data are not available to determine which, if any, 
of these procedures is better than the others. In other studies con- 
ducted at scientific research centers, the BI's have been completed 
at the subject's convenience. 

The collection of the North Carolina data was directed by 
Dr. Craig Phillips in association with Dr. Hugh Peck, Dr. James 
Sifford, and Dr. H. T. Connor, of the Smith Richardson Foundation. 

Data were collected from 39 schools in nine school districts repre- 
senting a stratified random sampling of North Carolina high school 
students. In each of the nine participating school districts, the 
school superintendent, or one of his assitants, assumed the responsi- 
bility for promoting and coordinating the activites at the local 
level. 

Table 1 lists the variables from the previous North Carolina 
study which were selected for the present study. With the exception 
of variables 3, 12, 13, 14, and 15, all of the variables listed in 
Table 1 were obtained from school records during the same tijne 
period in which the BI data were collected. Variable 3 was a binary 
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Table 1 



Selected Variables from the North Carolina Dcvta 



1 . 


Race (1 = Black; 2 = Anglo) 




2. 


Estimated Family Income 




3. 


Attended College (0 = No; 1 * Yes) 




4. 


Anglo and College preparatory = 1; 


Other 


5. 


Black and College preparatory = 1; 


Other 


6 . 


Rank in Class 




7. 


California IQ Test, Total Score 




8 . 


College Board, Verbal Score 




9. 


College Board, Quantitative Score 




10. 


College Board, Total Score 




11. 


Overall GPA 




12. 


Likeability 




13. 


IBRIC Creativity Key Score 




14. 


IBRIC Male CPA Key Score* 




15. 


IBRIC Female GPA Key Score* 




16. 


Grade (1 = Ninth; 2 = Twelfth) 




17. 


Sex (1 = Male; 2 * Female) 




18. 


Age 





♦In the Introduction these variables were described as the 
BI Academic Performance Score. 
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college attendance variable obtained in a follow-up study by Britt 
(1970). The college attendance data were collected during the 
1968-69 school year, and therefore were limited to some extent in 
that those students who were delayed for some reason (e.g., military 
service) more than one year between high school graduation and 
starting college were not included. Ninth grade students were not 
given a score for this variable. 

The likeability measure (variable 12) was a control score based 
on teacher ratings of cooperativeness and desirability as a student 
which were collected in conjunction with student evaluation forms 
completed by the teachers (James, Ellison, McDonald, 6 Taylor, 1968). 

Variable 13 was the a priori IBRIC Creativity Key used in the 
original North Carolina study. This key was developed on the basis 
of the NASA and other industrial studies. Variables 14 and 1$ were 
scores from the a priori IBRIC GPA keys developed in the Ohio Uni- 
versity study and used in the original North Carolina study. 

The remaining variables in Table 1 are self-explanatory with 
the possible exception of variable 2. Estimated family income 
(variable 2) was obtained from school records and was scaled as 
follows : 

1 = $3,000 or less per year. 

2 = From $3,001 to $5,000 per year. 

3 = From $5,001 to $7,000 per year. 

4 = From $7,001 to $9,000 per year. 

5 ■ $9,001 or more per year. 

The rank in class variable, as originally obtained, was each 
student's position in his class (based on GPA) divided by the number 
of persons in that class. This method of scaling resulted in a sign 
reversal when compared to other academic performance measures and 
differences in means and standard deviations between schools. Rank 
in class was therefore revised by standardizing each school to a mean 
of 500 and a standard deviation of 100 and reflecting each score about 
the mean. The resulting rank in class variable was therefore indepen- 
dent of school size and school grading differences. 
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Data Analysis 



Table 2 lists the samples which were selected for purposes of 
generating BI keys, the number of cases in each sample, and the 
criteria on which keys were developed for that sample. The "odd" 
designation in Table 2 refers to students with odd identification 
numbers which were assigned to the BI key generation samples, while 
students with even identification numbers were assigned to the cross 
validation samples. Since identification numbers were assigned 
randomly within schools, the above split was essentially the same as 
a random selection of students to samples within schools. 

Table 2 

Samples on Wnich Keys Were Generated 



Sample Name 


n 


Criteria on Which Keys 






Were Developed 



Odd cases from the Total 
Sample (combined Anglo 
and Black Samples) 


5524* 


Rank in Class, GPA, 
Family Income, 
College Attendance 


Odd cases from the Total 
Anglo Sample 


4153 


Rank in Class, 


GPA 


Odd cases from the Total 
Black Sample 


921 


GPA 




Odd cases from the five 
most integrated schools 


673 


GPA 





♦Data on race were not available for 450 of the odd cases from 
the total sample. 

As illustrated in Table 2, four samples were employed for the 
generation of BI keys. The odd cases from the total sample included 
all cases used for key generation. The *>dd cases from the total Anglo 
sample and from the total Black sample ir eluded all of the students on 
whom race information was available. The odd cases from the integrated 
schools sample included Anglos and Blacks from the total sample who 
were attending the five most integrated schools. 
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Four BI keys were developed on the total sample. The rank in 
class and GPA keys were constructed on the total sample in order to 
make comparisons in terms of validity with the BI keys constructed 
on Anglos and Blacks separately. The total sample family income 
key was developed to provide information about the attitudes, self- 
descriptions, and environmental characteristics associated with 
family income. Finally, a BI key was developed on the total sample 
to predict whether or not a student had attended college* It was 
anticipated that the biographical correlates of this key would pro- 
vide additional important information concerning the relationships 
between family income and achievement and later academic performances. 

Separate GPA keys for males and females were not constructed, 
as in the previous study the IBRIC male GPA keyscores (only males 
scored) and the IBRIC female GPA keyscores (only females scored) both 
correlated .88 with the empirically derived total sample GPA keyscore* 
These high part-whole intercorrelations between the keyscores demon- 
strated the similarities of item scoring in the separate mala and 
female keys. An item content and scoring analysis further sub- 
stantiated the similarities of the two keys. For these reasons, 
males and females were combined for all BI key construction in the 
present study. 

Separate BI keys were constructed to predict GPA for the Black 
sample and Anglo sample. Since previous GPA keys had been built on 
predominantly Anglo samples, an increase in prediction for the Black 
sample was expected from the key developed specifically for Blacks. 
However, for the same reason, a substantial increase in prediction 
for the Anglo sample was not expected, although some increase was 
hopefully anticipated. The small number of Blacks for whom the rank 
in class variable was available prevented the construction of a new 
BI key for rank in class on Blacks. A rank in class key was con- 
structed, however, on the Anglo sample in order to determine if any 
increase in validity might be available for this sample. 

The last key to be constructed was the BI key generated to pre- 
dict GPA for students in the five most integrated schools. This key 
provided an opportunity to investigate the relationships of bio- 
graphical data with other measures, such as academic achievement, 
which were assumed to be different for Anglos and Blacks within the 
same school setting. This opportunity was not available in the total 
sample because of the low percentage of total integration in that 
sample. 

Each sample was analyzed separately to establish the scoring 
weights for the items which differentiated between various levels 
of performance on each of the criterion measures for that parti- 
cular sample. More specifically, biserial and point biserial 
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correlations were computed for each item alternative with each 
criterion within each sample. After these correlations were 
computed, all the correlations were screened for statistical signi- 
ficance. A scoring key was then generated for each criterion con- 
sisting of all alternatives in the BI which had significant biserial 
correlations with that criterion. The alternatives with significant 
positive correlations were weighted plus 1 and those with significant 
negative correlations were weighted minus 1. 

Biographical keys to predict all selected criteria across all 
samples were generated in one run on the University of Utah Computer 
Center's Univac 1108, utilizing a program originally developed by 
IBRIC personnel. In addition to the keys, output from the program 
included, for each BI item with each selected criterion within each 
sample, the percentage of individuals choosing each item alternative, 
the actual number of individuals responding to each alternative, and the 
criterion mean for those individuals who selected each alternative. 

The program also provides the biserial and point biserial correla- 
tions of each item alternative with each criterion and the standard 
error for the biserial together with the eta coefficient of the total 
item continuum with each criterion and the standard error of the eta. 

In the construction of a scoring key for the analysis of bio- 
graphical data to predict an outside criterion, the emphasis is 
usually placed on obtaining a very high cross validity coefficient 
for the key in predicting that criterion on an independent sample. 

This in turn is a function of at least four parameters: (1) number 
of items; (2) the magnitude of the correlations of individual item 
alternatives with the criterion; (3) the expected stability of the 
item alternative-criterion correlation which in turn varies with 
the significance level; and (4) item heterogeneity. In the analysis 
of the present data, different strategies were utilized in order to 
obtain keys which would produce high cross validity coefficients. In 
building a BI key to predict the criteria on the total sample, cut-off 
levels for BI item scoring, and retention in a scoring key, of at 
least 5% of the sample responding to the item alternative and a 
correlation between the item alternative and the criterion of a least 
plus or minus .20 were employed. For a sample of t h is size (e.g., 
n=4059) , this was an unusually stringent cut-off as it ensured that 
any item selected would be signficiant far beyond the .01 level of 
confidence. This significance level was selected in view of previous 
experience with biographical data as one which would come close to 
obtaining the desired balance across the item selection parameters. 

That is, a sufficient number of items would be scored, high item- 
criterion correlations would be selected which would be highly 
reliable, and because the number of items selected would be large, 
some item heterogeneity would also be obtained. While this statistical 
keying procedure for the analysis of the BI data was satisfactory 
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for the rank in class variable (101 items keyed) and GPA variable 
(92 items keyed) on the total sample, it resulted in a key of only 
46 items being scored for the Family Income Key. Since this was 
less than a desired number of BI items, the item analysis computer 
printout was screened by hand and additional items were selected, 
all of which met statistical significance requirements at the .01 
level of confidence or beyond, to lengthen the Family Income Key. 

As a result of this procedure, 46 additional items were identified 
which had one or more significant item alternative-criterion 
correlations (totaling 92 items in the final Family Income Key). 

The selection of the additional 46 items, although somewhat arbitrary, 
will permit a description of the most significant life history 
correlates of family income. These results did indicate that the 
magnitude of correlations between life history data and family in- 
come were somewhat limited, although a large number of statistically 
significant relationships were obtained. Also, as will be demon- 
strated in the next section of this report, the family income BI key 
had substantial cross validities against the family income criterion. 

The BI key built on the total sample to predict the binary 
college attendance variable was based on a similar strategy for 
similar reasons. The computer generated key for college attendance 
was also based on a cut-off level of 5% of the sample responding to 
the item alternative and an item alternative-criterion correlation 
greater than or equal to .20 in magnitude. The resulting key was 
based on alternatives contained in only 27 items. Again, the item 
analysis printout was screened by hand and additional item alter- 
natives were selected which met statistical significance at the 
.01 level of confidence. The final total sample BI key for the 
college attendance criterion was based on alternatives contained 
in 77 items. Again, as will be demonstrated, this key had a mean- 
ingful pattern of cross validity coefficients. 

The keys built on the large Anglo sample to predict rank in 

class and GPA were also based on more than 5% of the sampie answering 

an item alternative and an item alternative-criterion correlation 
greater than or equal to .20 in magnitude. The Anglo rank in class 
key contained 110 items with keyed alternatives and the Anglo GPA 
key contained 101 such items. 

For the two BI keys constructed to predict GPA on the Black 
sample and the sample of students in integrated schools, a cut-off 
level of item alternative-criterion correlations significant beyond 
the .01 level was used. This was in contrast to the previously 

discussed cut-off level of at least 5% of the sample responding to 

the item alternative and an item alternative-criterion correlation 
greater than or equal to .20 in magnitude. The decision tD use 
this cut-off was due to the smaller sample sizes under consideration 
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(n=885 for Blacks and n-648 for integrated schools on the GPA 
variable). The computer generated keys resulting from this pro- 
cedure contained 253 scorable items on the Black sample and 259 
scorable items on the integrated sample. In order to prevent the 
keys from being dominated by extremely small but significant 
correlations (e.g., for n=885, an eta of .08 or greater is signi- 
ficant at the .01 level) bf/th keys were screened by hand, elimi- 
nating those item alternativercriterion correlations deemed too 
small. The final GPA key for Blacks contained 79 items with keyed 
alternatives and the final GPA key for students in integrated schools 
contained 107 items with keyed alternatives. 

Following their development, the eight scoring keys were used 
to score the item responses of all the even numbered cases in order 
to estimate the predictive effectiveness of the BI on cross valida- 
tion samples. The reason for this method of analysis was that the 
use of the same group (the total Black sample for instance) for both 
the development of the scoring weights and the application of these 
weights always produces results which are spuriously high and thus 
fails to give an accurate estimate cf the effectiveness of the 
instrument. Cross validation of the scoring keys on a separate 
sample provides an estimate of the effectiveness of the procedure 
on another independent group. 

As presented above, all even numbered cases were scored with 
all of the BI keys. This provided an opportunity to investigate 
the cross validities of all keys against all criteria on all cross 
validation samples (explained below), regardless of where the key 
was constructed. For example, the BI key built on Anglos to pre- 
dict Anglo-GPA was used to score the total cross validation sample, 
the Anglo sample, the Black sample, and the sample of students in 
integrated schools to obtain the cross validity of the Anglo-GPA 
key against the GPA criterion across the various samples studied. 

The samples on which cross validities were determined are 
presented in Table 3. The first four samples in Table 3 are com- 
parable to those pn which the keys were developed. Samples 5 and 6 
represent the separate samples of Anglos and Blacks included in the 
integrated schools sample (sample 4). Separate correlation and 
cross validity matrices were computed for the Anglo students in 
integrated schools (Anglo- Integrated) and the Black students in 
integrated schools (Black-Integrated) sample in order to investigate 
the similarities and differences between students enrolled in 
integrated schools versus students enrolled in schools with little 
or no integration. 



Table 3 



Samples on Which Correlation Matrices Containing 
Cross Validity Coefficients Were Computed 





Sample Name 


n 


1 . 


Even Cases from the Total Sample 


5524* 


2. 


Even Cases from the Total 
Anglo Sample 


4166 


3. 


Even Cases from the Total 
Black Sample 


888 


4. 


Even Cases of the Students in 
Five Most Integrated Schools 


674* 


5. 


Even Cases of Anglos in 
Five Most Integrated Schools 


530 


6. 


Even Cases of Blacks in 
Five Most Integrated Schools 


129 



*Data on race were not available for 470 of the even cases 
from the total sample including 15 cases in the integrated 
schools sample. 
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RESULTS 



The results of this study will bo presented by means of the 
correlation and validity matrices computed for each of the major 
samples presented earlier in Table 3. Correlations and validities 
for the total cross validation sample, Anglo sample, and Black 
sample will be presented individually, while the results of the 
analysis on the total integrated schools sample will be presented 
in conjunction with the results found on the Anglo students in 
integrated schools and the Black students in integrated schools. 
Following the presentation and discussion of the correlation and 
validation matrices, the biographical correlates of family income 
will be discussed. 

In the presentation of each of the correlation and validity 
tables, the correlations and validities (with decimals omitted) 
are included in the lower- left traiangular matrix (the half of the 
matrix below the diagonal). The upper-right triangular matrix 
(above the diagonal) includes the sample size (n) for each corre- 
lation. Since a number of the variables employed in the present 
study had varying sample sizes, the matrix of was incorporated 
in the tables so that different significance levels could be 
ascertained. Means, standard deviations, and sample sizes for 
each variable are included in either the correlation and validity 
table or in a separate accompanying table. 

Analysis of Total Cross Validation Sample 

Means, standard deviations, and sample sizes for each vari- 
able included in the total sample analysis are presented in Table 4. 
The total sample correlation and cross validation matrix is pre- 
sented in Table 5. Since a one-way cross validation analysis was 
conducted in the present study, it was appropriate to compare the 
statistics in Table 5 with the results obtained in the original 
North Carolina study (1BRIC, 1968), to ascertain if any differences 
occurred between the cross validation sample (n=5524) in the present 
study and the original North Carolina cross validation sample 
(n=ll,246). With few exceptions, the results found in Table 5 were 
comparable with those obtained in the original North Carolina study. 
For example, race and family income correlated .51 in the original 
North Carolina study and .50 in the present investigation. The 
total percentage of Blacks in the original study was 19%, while in 
the present study this percentage was 18%. In the total North 



Means, Standard Deviations, and Sample Sizes 
for All Variables in the Total Cross Validation Sample 



Variables 

1. Race (1-Mack, 2= Anglo) 

2. Family Income 

3. Att.Coll. (0=Nc >s) 

4. Anglo, Coll. Prep. (0=No, l=Yes) 

5. Black, Coll. Prep. (0=No, l=Yes) 

6. Rank in Class 

7. California IQ Test 

8. College Board, Verbal Score 

9. College Board, Quant. Score 

10. College Board, Total Score 

11. CPA 

12. Likeability 

13. IBRIC Creativity Key 

14. IBRIC Male GPA Key 

15. IBRIC Female GPA Key 

16. Grade (l«Ninth, 2=Twelfth) 

17. Sex fl=Male, 2«Female) 

18. Age 

19. Rank in Class Key-Total Sample 

20. GPA Key-Total Sample 

21. Rank in Class Key-Anglo Sample 

22. GPA Key-Anglo Sample 

23. Family Income Key^Total Sample 

24. Att.Coll. Key-Total Sample 

25. GPA Key-Black Sample 

26. GPA Key-Integrated Schools 



Mean s.d. 



1.82 


.38 


3.03 


1.26 


.26 


.44 


.39 


.49 


.19 


.39 


499.77 


100.31 


105.24 


15.95 


445.12 


103.02 


468,65 


105,66 


913,77 


193,23 


.21.37 


9,06 


30.32 


9.06 


102.14 


5,95 


101,00 


15,79 


99,54 


17,86 


1.45 


,50 


1,52 


,50 


16,02 


1,63 


97.72 


21,63 


103.06 


19.81 


98,57 


24,30 


101,18 


21,54 


101,65 


22,05 


100.30 


19.25 


104.54 


16,93 


107,93 


20,11 



n 

5054 
4034 
2479 
3652 
797 
2332 
2296 
1131 
1131 
1131 
4849 
5524 
5524 
2635 
2889 
5524 
5524 
5415 
5 524 
5524 
5524 
5524 
5524 
5524 
5524 
5524 



\ 
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CPA K«y-IntirT*fd School* 2<»j *5 *0 40 41 46 73 52 S3 44 52 67 68 SO 85 86 -03 



